Amazon AWS has launched a Human Benchmark Testing team to enhance AI model evaluation. Amazon aims to help users better assess AI models and encourages more people to participate in this process. AWS provides model evaluation on Bedrock to assess models in its repository. Model evaluation consists of both automated and human assessments, which can evaluate model performance based on different metrics. AWS also offers a human evaluation team to collaborate with users and detect metrics that automated systems cannot.

Amazon AWS has launched the Amazon EC2 Capacity Blocks service, allowing users to reserve Nvidia H100 GPU resources on demand. Users can reserve 1 to 64 instances, each with 8 GPUs, for a maximum of 14 days. Prices will dynamically change based on supply and demand for GPU resources, enabling users to adjust according to their needs and budget. This service is initially available in the AWS US East region and aims to alleviate the shortage of GPU resources for AI projects. This new on-demand purchasing and scheduling method allows users to...

["IBM announced today the expansion of its partnership with Amazon AWS to promote generative AI solutions.", "IBM will train 10,000 consultants by the end of 2024 to deepen its expertise in generative AI on AWS.", "This collaboration will help clients implement generative artificial intelligence and deliver greater value."]